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In educational assessment, what students . say , do, and 
sometimes make is observed, and assessors attempt to infer what students 
know, can do, or have accomplished more generally. Some links in the chain of 
inference depend on statistical models and probability-based reasoning, and 
it is with these links that terms such as validity, reliability, and 
comparability are typically associated, constituting psychometric principles, 
as it were. Familiar formulas and procedures from test theory provide working 
definitions and practical tools for addressing those more broadly applicable 
qualities of the chains of argument from observations to inferences about 
students, as they apply to familiar methods of gathering and using assessment 
data. This report has four objectives: (1) it offers a framework for the 

evidentiary arguments that ground assessments; (2) examines where 
psychometric principles fit in this framework; (3) shows how familiar 
formulas apply these ideas to familiar forms of assessment; and (4) looks 
ahead to extending the same principles to new kinds of assessment. (Contains 
13 figures and 85 references.) (Author/SLD) 
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